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This report is a summary of work done under Grant NAG1-946 for the period 19 
December 1988 through 15 August 1992. Most of the technical work is described 
in the papers produced, including the NASA Contractor Report 4393 - 'Optimal 
Control Problems with Switching Points'. In the following pages we present a list 
of the papers along with a brief abstract. The technical work during the last 
months of the grant has not yet been submitted for publication so we present a 
summary of that work in an Appendix. 


Students Supported 

In addition to the technical work a principal result of this work is the graduate 
study supported by it. The following students have been supported, in part, 
under this activity: 


• Hans Seywald, Ph.D. student. Aerospace and Ocean Engineering 
Department. 

• Pangiotas Tsiotras, Ph.D. student. Aerospace and Ocean Engineering 
Department. 

• Diane DeWalt Smith, Ph.D. student. Aerospace and Ocean Engineering 
Department. 

• Marwan Bikdash, Ph.D. student. Electrical Engineering Department. 

• William Waldron, Ph.D. student. Aerospace and Ocean Engineering 
Department. 



Papers Produced 

H. Seywald and E.M. Cliff, 'Optimal Rocket-Powered Ascent Study', Proc. of the 
American Control Conference . Pittsburgh, PA, June 1989, pp. 2026-2031 ; also 
Guidance Control and Dynamics , to appear. 

The Goddard Problem is that of maximizing the final altitude for a 
vertically ascending, rocket-powered vehicle under the influence of an 
inverse square gravitational field and aerodynamic drag. The present 
paper is concerned with the effect of two additional constraints; a 
dynamic pressure limit (qmax) ^f^^l a specified time of flight (tf). Nine 
different switching structures involving zero-thrust (coasting) arcs, full- 
thrust arcs, singular-thrust (sustaining) arcs and state-constrained arcs 
are obtained for prescribed values of the parameters qmax ^f- 
Finally, a comparison is given between the optimal thrust program and a 
simple intuitive feedback law. 

E.M. Cliff, 'A Singular Perturbation Approach to Pitch-Loop Design', Proc. of the 
American Control Conference . San Diego, CA, May 1990, pp. 1819-1823 

Singular perturbation ideas are used to design a pitch-loop controller for 
a thrusting vehicle. The main feature of this approach is that the inner- 
loop design is based on a performance criterion that is consistent with 
the minimum-fuel index that was used in shaping the trajectory. The 
inner-loop design can be approximated by a linear-quadratic problem so 
that the resulting quadratic index is meaningful for fuel-efficient 
operation. The quadratic index that results is non-intuitive and features a 
control-state weighting term and zero-weight on the state itself. We 
define a coupling parameter that indicates when the state dynamics can 
be successfully separated into 'slow' and 'fast' categories. 


H. Seyvyald, 'Optimal Control Problems with Switching Points', Ph.D. 
Dissertation. Virginia Polytechnic Institute and State University, Blacksburg, VA 
July 1990. (also NASA CR-4393) 

H. Seywald, R.R. Kumar and E.M. Cliff, 'A New Proof of the Jacobi Necessary 
Condition', Proc. of the American Control Conference . Boston, MA, June 1991; 
also J. Guidance Control and Dynamics, to appear. 

Jacobi's necessary condition states that a minimizing extremal does not 
contain any conjugate points. This result has practical value because it 
enables one to discard any extremals that fail the conjugate point test. 

While the available proofs establish the theorem under the hypothesis 
that the test extremal is smooth, many applications give rise to non- 
smooth extremals. In this paper we present a proof that is valid for the 
case of extremals with corners. 



H. Seywald and E.M. Cliff, 'A Feedback Control System for the Advanced 
Launch System', Proc. AIAA Guidance. Navigation and Control Conf. . New 
Orleans, LA, August 1991, pp. 172-181. 

A robust feedback algorithm is presented for near minimum-fuel ascent 
of a two stage vehicle operating in a vertical plane. The approach is 
based on neighboring optimal control ideas but employs feedback gains 
determined by finite differences applied to a family of extremals. 
Performance and robustness of the feedback law are found to be 
excellent. 


H. Seywald, E.M. Cliff and K.-H. Well, 'Range Optimization for a Supersonic 
Aircraft', Proc. AIAA Guidance. Navigation and Control Conf. . New Orleans, LA, 
August 1991, p 967-974. 

Range-optimal trajectories for an aircraft flying in the vertical plane are 
determined form Pontryagin's Minimum Principle. Controls are the load 
factor, which appears nonlinearly in the model and the throttle, which 
appears only linearly. The controls are subject to fixed bounds and the 
state-inequality restricting the dynamic pressure is also imposed. The 
solutions contain state-constrained arcs and along these the controls are 
sometimes singular. A total of six different switching structures is found, 
depending on the value of the load-factor bound. 

H. Seywald, 'Optimal Control Problems with Switching Points', NASA Contractor 
Report 4393 . September 1991. 

A brief discussion of existing optimality conditions is given and a 
numerical approach for solving the multipoint boundary value problems 
associated with the first-order optimality conditions is presented. Two 
realistic aerospace optimization problems are treated explicitly, these are 
altitude maximization for a sounding rocket (the Goddard Problem) in the 
presence of a dynamic pressure limit, and the range optimization for a 
supersonic aircraft in vertical plane flight, also in the presence of a 
dynamics pressure limit. An extension of the Generalized Legendre 
Clebsch condition to the case of singular control along a state/control 
constrained arc is presented and is applied to the aircraft range 
optimization problem. 



Appendix 

Optimal Ascent with Pitch Dynamics 


by 


William Waldron 


Abstract 


Optimal ascent paths for rocket-powered vehicles are commonly studied 
using point-mass models. In these formulations important gust-load 
constraints must be imposed in approximate form as q (dynamic- 
pressure) or q-(x bounds. Thus, it is of interest to study these paths with 
more complete rigid-body models. In this section we begin with a review 
of the optimal ascent problem in point-mass approximation. The analysis 
is then extended to include pitch dynamics in boundary-layer 
approximation. The present effort includes the zeroth-order outer 
solution wherein the pitch dynamics are equilibrated and treated as 
algebraic equality constraints in the point-mass model. Future work will 
extend this to include the q-a dynamics in boundary-layer approximation 
and to compare these to numerical solutions with a full pitch-plane rigid 
body model. 



Point Mass Model: 


Mathematical Framework; 


Equations of Motion 

In order to analyze the trajectory of our launch vehicle we express our 
system by the mathematical model; 

x = f(x,u) x^ = (r.fV.Y.m) 

u" = (e) 

where 

r = distance from center of earth to vehicle (radius) 

4) = downrange angle 

V = velocity of the vehicle 

Y = flight path angle of the vehicle 
m = vehicle mass 

and 

8 = engine deflection with respect to body. 

See Figure 1 for a depiction of these states variables. 


The equations of motion are; 
f = V-sinY 
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V • cos Y 


T-cose-D 

V = g-sinY 
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T • sine + L 
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where the gravitational acceleration is modeled as g = Qq • 






These equations which are in dimensional form are often difficult to work 
with numerically. To alleviate some of the difficulties the equations are scaled 
and non-dimensionalized. This results in all the state variables having values 
near unity. The following scaling factors are used; 



scale length: r = earth radius 

scale mass; m = initial vehicle mass 

scale acceleration: a = gravitational acceleration at surface 

These scale factors lead to the following additional scale factors; 

scale time: t = 


scale force: 

f = ^ 
t‘ 

scale velocity: 

^ r 

V = -. 
t 



If we now define our new non-dimensional variables as follows: 
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Note that the variables that represent angular measurements are not modified. 


The equations of motion can now be written in non-dimensional form. For 
reasons of visual clarity the notation will be dropped from the non- 
dimensional variables. From this point on all variables will be non-dimensional 
unless otherwise noted. Our non-dimensional equations of motion are, 

f = V-siny 

i V-cosy 

<|) = 

r 

- T-cose-D siny 


m 



CL(M,a) = CLjM)-(a-Jf) 

Cl,_(M) = C,(M) + C2(M) + C3(M) 


Ci(M) = C,o +C„-tan-'(C,2-M-Ci3) 
C3(M) = C30 + C3, • tan‘XC32 -M - C33) 


with function coefficients given in Tables 1 and 2. 

In order to simplify the point mass model, the angle of attack dependence 
has been removed by holding a=0 throughout the trajectory. It has been shown 
for this vehicle that if the angle of attack is varied between plus and minus ten 
degrees the variation in all aerodynamic forces constitutes less than 1% of the 
total force acting on the vehicle. [2] A plot of the drag coefficient. vs. Mach 
number at a=0 is shown in Figure 2. 

Atmospheric Model 

The atmospheric model us such that the speed of sound, a[m/s], and 
density, pfkg/m^], are given by the following relations; 

3['%] = 3o '[^0 +h-c, +h^ - Cj + h-c^ + h-c^ +h-c® +h-c®] 

P[%] = b3-e^ J 

where h is the altitude in kilometers and the function coefficients are given in 
Tables 4 and 5. 


Optimization Approach: 


Problem Statement 

The task at hand is to launch the vehicle into an orbit with a specified 
semi-major axis and orbit eccentricity using the least amount of fuel. These 
terminal conditions can be defined by the following constraints. 




1 P 2 = cos' Y (tf ) • [v(t, y ■ r(t, )' - 2 • V(t • r(t J] + 1 - e' = 0 

where a is the desired semi-mafor axis and e is the desired orbit eccentricity. 

In addition to these constraints on the state variables at final time, there 
are also constraints on the mass at staging; 



^I '3 =m(t;)-m; =0 

= (m; -Amj-m(t;) = 0 

where m; is the desired vehicle mass before staging. Am^ is the desired change 

in vehicle mass at staging, m(t;) is the vehicle mass before staging, and m(tg ) is 

the vehicle mass after staging. At staging the aerodynamics of the vehicle 
change, but the dynamic pressure has dropped off significantly resulting in this 
change having negligible effect on the trajectory. For this reason the 
aerodynamic model does not change at staging which results in a simplification 
of the simulation. 

We can now define our cost or performance index, J. as; 

J = -m(t,). 


Hamiltonian 

To solve the optimal control problem we shall employ the Minimum 
Principle. Accordingly we define the usual variational Hamiltonian. 


H = -fCx.u) = X, •[V-sinY] + 
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Costate Differential Equations 

The differential equations for the costates are given by the relation, 


X =- — 

' dX, ' 


For our problem this results in the following differential equations for the 
costates: 
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Control Calculation 

Our control, u(t), can be determined by looking for a u(t) that minimizes 

dH 

the Hamiltonian. We can find such a control by setting — = 0 and solving for 

du 

u(t). 


f)H aH ^ T-sine , T-cose 
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This gives our control, u(t)=e(t), as a function of the costates A^ and Ay as well as 
the state variable V. There is still a quadrant resolution problem to be solved. In 

order to resolve the ambiguity we require that — ^ ^ 0. This leads to the 


ae^ 


expression: 


y ^ sine - 

-Ay cos e - A„ i 0 . 

V Y y 

Using this expression the correct quadrant for our control, e, is specified. 



Terminal Conditions 

We now need to determine the terminal conditions on our costates. To do 
so we define a function, O, made up of our cost function and the dot product of 
constant multipliers. Vj, and our terminal and staging conditions \jv 


o = J + -'ll) = -m(t,) + V, 
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The boundary conditions on our costates at final time are determined by the 


relation- X (t) = < ■. Our terminal conditions on the costates become 
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In addition, since our final time is unspecified: H(tf) = 0. 


Staging Conditions 

When the launch vehicle reaches a specified value of mass, mj, staging 
occurs. During staging, which is assumed to occur instantaneously in our 
model, the vehicle mass is reduced by a specified value of Am,. In addition to 
the change in the state variable, m, the corresponding costate also is 
discontinuous. The values of our costate both before and after staging are given 
by the following relations [3]; 



which leads to the conditions; 

Since both ^3 and are arbitrary, these two relations can be reduced to 

where AX,„(t J is an unknown to be determined. We also know that the value of 
the Hamiltonian, H, does not change during staging. 

H(t;)-H(i;)-o 

Multi-Point Boundary Value Problem 
Our problem is now a multi-point boundary value problem. Our known 
values at initial time, to=0, are 

r(0) = To 

«l>(0) = <t.o 

V(0) = Vo 

y( 0) = Yo 

m(0) = mo 

with m(t; ) = m(t; ) + Am, at Staging. 

The above problem needs to be solved using the state and costate 
differential equations for the following nine unknowns, 

^(0). ^♦(0). >^v(0). \(0). Ki^l tf. 1^1. -U2. to meet the following nine 

conditions. 
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(8) cos^Y(tf)-[v(tJ'T(t,r-2-V(tJ"-r(t,)] + l-e^ = 0 

(9) H(t,) = 0. 


Point Mass Solution 

The above problem was solved using Newton's method to find the nine 
unknowns. The solution converges rapidly once the initial guess for the 
unknowns are sufficiently close to the solution. The resulting control history, e(t) 
vs. time, can be seen in Figure 3. Time histories of the state and costate 
variables can be found in Figures 4-10. 


Pitch Plane Model : 

Mathematical Framework: 


Equations of Motion 

As before, in order to analyze the trajectory of our launch vehicle we 
express our system by a mathematical model; 

x = f(x,y,u) x^ =(r,(|).V,Y,m) 

6y = g(x,y.u) y^ = (e.q) 

u"=(e) 

Our first set of state variables, x, are the same as in the point mass model and 
our new state variables, y, are the variables necessary to model the pitch plane. 
0 = angular position of vehicle w.r.t local horizontal 
q = angular rate of vehicle in pitch plane 

The equations of motion for the pitch plane model are; 
f = V-sinY 

V • cos Y 
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Aerodynamic Model 

The pitch plane model necessitates the addition of pitching moment data 
into our model. The pitching moment about the center of mass is given as 

M = q-S-c-CM- 

The moment coefficient is a function of Mach number and angle of attack and is 
surface fit by the relation; 

CjM,a) = L{M,a) + E{M,a) 

L(M, a) = L, • M • (a • ) + Lj • (a • Jf-) + L3 -M + L4 


arg(M) = 


r (M - Mo ) • (m, - tan-^Mj • (M - Mo ))/n) Y 


Plots of the surface fitted aerodynamic coefficients 0^, 0^, and C^, can be seen 
in Figures 11, 12, and 13. 


Pitch Moment of Inertia 

The pitch moment of inertia for the launch vehicle is varied linearly as a 
function of vehicle mass. 


Reduced Order Model: 


Equilibrium Constraints 

In order to ease the transition from the point mass model to a pitch plane 
model we will first look at a reduced order pitch plane model. This is 
implimented by letting our time scale variable, 6, go to zero in the above model. 
This implies that g(x,y,u) = 0 and our pitch plane variables 0 and q become 
"control like". The resulting pitch plane constraints are; 

q = 0 
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Hamiltonian 

We again employ the Minimum Principle and define our variational 
Hamiltonian. 
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Costate Differential Equations 
The costate differential equations are; 
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Control Calculation 

We again set the derivative of the Hamiltonian v\/ith respect to each 
control to zero. 
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The above three equations along with the two pitch equilibrium equations 
need to be solved for the five unknowns; q, 0, e, v^, and Dj. It can easily be 

seen that the variables q and are equal to zero and decouple from the rest of 
the system. Therefore the problem of solving for our control reduces to a 
system of three equations and three unknowns. 
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The above equations are nonlinear and must be solved iteratively for the 
unknowns throughout the trajectory. 


Multi-Point Boundary Value Problem 

Since the reduced order model does not introduce any new state 
variables, 0 and q are treated as controls, the initial, staging, and terminal 
conditions are the same as in the point mass boundary value problem. 

Shooting Point Technique 

With added complexity of the pitch plane model numerical difficulties start 
to arise. These difficulties are a result of integrating the costate differential 
equations which are unstable. To work around the instabilities the intervals both 
before and after staging are broken down into several smaller intervals. The 
idea is to have the intervals small enough so that the unstable costates do not 
"blow up" before the end of the interval is reached. 

At the beginning of the next the costates are reset to new initial values 
and the integration is continued. After the integration is complete for the entire 
trajectory the initial values for each interval are adjusted in an attempt to match 
end conditions on each interval as well as the boundary conditions for the entire 
problem. This technique is useful in alleviating some of the numerical 
instabilities but results in a larger Newton problem with more unknowns. 

Reduced Order Pitch Plane Solution 

The control history. e(t) vs. time, and angle of attack history, a(t) vs. time, 
for the optimal trajectory can be found in Figures 14 and 15 respectively. Time 
histories of the state and costate variables can be found in Figures 16-22. 
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Table 3: Coefficients for C„ functionalization 
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Table 4; Coefficients for speed of sound model 
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Table 5: Coefficients for density model 
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Figure 9; State Variables for Point Mass Model 
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Figure 1 0: Costate Variables for Point Mass Solution 





Figure 1 3: Pitch Moment Coefficient Surface Plot 
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Figure 1 4 : Control History, c(t), for Reduced Pitch Plane Solution 
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Figure 1 5: Control History, a(t), for Reduced Pitch Plone Solution 
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Figure 1 6: Radius History for Reduced Pitch Plane Solution 
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Figure 21 : State Variables for Reduced Pitch Plane Solution 



Figure 22: Costate Variables for Reduced Pitch Plane Solution 




